Schedule

Slides

The term no one really defined

• What is data science?

Data science is the discipline of making data useful. Ok…so what is it?

What is “hard-core pornography”?

• Obscenity case of Jacobellis v. Ohio (1964)

What is “hard-core pornography”?

• Obscenity case of Jacobellis v. Ohio (1964)

“I know it when I see it. (Potter Stewart)”

Three tracks of data science

• Engineering: the process of making everything else possible

• Analysis: the process of turning raw information into insights in a fast way

• Modeling: the process of diving deeper into the data to discover the pattern we don’t easily see

(It is a group work from https://github.com/happyrabbit/academic_advisory/blob/master/authors.md !)

Engineering

Analysis

Modeling

Three tracks of data science

Three tracks of data science

Three tracks of data science

What can (should) data science do?

• Make human better human by alleviating bounded rationality and minimize politics/emotion (rather than make machine more like human)

• Strive for the “democratization” of data as legally possible: empower everyone in the organization to acquire, process, and leverage data in a timely and efficient fashion

Data Science Hierarchy of Needs

Data Science Types v.s Needs

Data Science Types v.s Needs

Data Science Types v.s Needs

Data Science Types v.s Needs

Types of Questions

• Comparison:
  • Are males more inclined to buy our products than females?
  • Are there any differences in customer satisfaction in different business districts?
  • Do soybean carrying a particular gene have higher oil content?
• Description:
  • Is the distribution of annual income normal?
  • Are there outliers?
  • What are the means of different customer segments?
• Clustering:
  • Which customers have similar product preference?
  • Which printer performs similar pattern to the broken ones?
  • How many different themes are there in the corpus?

Types of Questions

• Classification:
  • Who is more likely to buy our product?
  • Is the borrower going to pay back?
  • Is it a spam?
• Regression:
  • What will be the temperature tomorrow?
  • What is the projected net income for the next season?
  • How much inventory should we have?

Types of Learning

• Supervised Learning
  • Input data labeled
  • Classification and regression
• Unsupervised Learning
  • Input data not labeled
  • Clustering
• Transfer Learning

Data Scientist Skill Set

General Process

Automatic Data Science Pipeline

Some links

• Industry recommendations for academic data science programs

• Awesome-Data-Science-Materials

• Online books:
  • The Elements of Statistical Learning
  • An Introduction to Statistical Learning
  • Introduction to Data Science(still writing)
• Hard copy books:
  • Applied Predictive Modeling
  • R for Marketing Research and Analytics

• Big Data with R